"The highlighted tokens are primarily Japanese function words, particles, and common suffixes or inflections that mark grammatical relationships, connect clauses, or indicate possession, location, or action. These tokens are essential for sentence structure and meaning, often appearing at phrase or clause boundaries, and are frequently used in both formal and informal contexts."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.62 | 0.833 | 0.3 | 0.441 | 0.3 | 0.94 | 0.06 | 0.7 |
fuzz | 0.79 | 0.854 | 0.7 | 0.769 | 0.7 | 0.88 | 0.12 | 0.3 |